Nearest prototype classifier designs: An experimental study
نویسندگان
چکیده
We compare eleven methods for finding prototypes upon which to base the nearest Ž prototype classifier. Four methods for prototype selection are discussed: Wilson Hart a . condensation error-editing method , and three types of combinatorial search random search, genetic algorithm, and tabu search. Seven methods for prototype extraction are discussed: unsupervised vector quantization, supervised learning vector quantization Ž . with and without training counters , decision surface mapping, a fuzzy version of vector quantization, c-means clustering, and bootstrap editing. These eleven methods can be usefully divided two other ways: by whether they employ preor postsupervision; and by whether the number of prototypes found is user-defined or ‘‘automatic.’’ Generalization error rates of the 11 methods are estimated on two synthetic and two real data sets. Offering the usual disclaimer that these are just a limited set of experiments, we feel confident in asserting that presupervised, extraction methods offer a better chance for success to the casual user than postsupervised, selection schemes. Finally, our calculations do not suggest that methods which find the ‘‘best’’ number of prototypes ‘‘automatically’’ are superior to methods for which the user simply specifies the number of prototypes. 2001 John Wiley & Sons, Inc.
منابع مشابه
Presupervised and post-supervised prototype classifier design
We extend the nearest prototype classifier to a generalized nearest prototype classifier (GNPC). The GNPC uses "soft" labeling of the prototypes in the classes, thereby encompassing a variety of classifiers. Based on how the prototypes are found we distinguish between presupervised and postsupervised GNPC designs. We derive the conditions for optimality (relative to the standard Bayes error rat...
متن کاملFuzzy Nearest Prototype Classifier Applied to Speaker Identification
In a vector quantisation (VQ) based speaker identification system, a speaker model is created for each speaker from the training speech data by using the k-means clustering algorithm. For an unknown utterance analysed into a sequence of vectors, the nearest prototype classifier is used to identify speaker. To achieve the higher speaker identification accuracy, a fuzzy approach is proposed in th...
متن کاملRegularized margin-based conditional log-likelihood loss for prototype learning
The classification performance of nearest prototype classifiers largely relies on the prototype learning algorithm. The minimum classification error (MCE) method and the soft nearest prototype classifier (SNPC) method are two important algorithms using misclassification loss. This paper proposes a new prototype learning algorithm based on the conditional log-likelihood loss (CLL), which is base...
متن کاملOn the use of evolutionary feature selection for improving fuzzy rough set based prototype selection
The k-nearest neighbors classifier is a widely used classification method that has proven to be very effective in supervised learning tasks. In this paper, a fuzzy rough set method for prototype selection, focused on optimizing the behavior of this classifier, is presented. The hybridization with an evolutionary feature selection method is considered to further improve its performance, obtainin...
متن کاملA Genetic Tuned Fuzzy Classifier Based on Prototypes
It is known that main drawbacks of the k-Nearest Neighbors classifier are related to the need for keeping all the training prototypes. Although there are several approaches capable to significantly reduce the size of the case base, they damage the classification accuracy. We propose a novel fuzzy approach that significantly reduces the prototypes base and also improves the classification accura...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Int. J. Intell. Syst.
دوره 16 شماره
صفحات -
تاریخ انتشار 2001